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TITLE OF THE INVENTION 



OPTICAL DEVICE AND METHOD FOR SELECTING OBJECT OF FOCUS 

BACKGROUND OF THE INVENTION 

The present invention relates to an optical device, 
such as an automatic focusing camera and a monitor 
camera, having an automatic focusing function. 

Various techniques for measuring distances to 
objects which are in different directions using an 
optical device are known. One of these techniques is 
disclosed in the Japanese Patent Publication No. 4-67607. 
Further, a plurality of techniques for estimating an 
area, in the object space, which includes a main object 
on the basis of distance distribution information of the 
objects obtained by using the techniques for measuring 
distances to the objects are disclosed. 

Below, a typical conventional method of estimating 
an area which includes a main object is explained with 
reference to Figs. 15A to 15C. 

First, a scene, such as the one shown in Fig. 15A, 
is sensed by using a pair of image sensing devices, such 
as CCDs, arranged inside of an optical device, such as a 
camera, at a predetermined distance from each other. Two 
images, sensed by the pair of image sensing devices, 



which have parallax are respectively divided into M x n 
blocks* Then, by performing known correlation operation 
between signals of a given block of one of the two 
images and signals of the corresponding block of the 
5 other image, it is possible to obtain the distance to an 
object and/or a defocused amount of the block based on 
trigonometry principle. The correlation operation is 
performed on every block, and distance distribution 
information of M x n blocks as shown in Fig. 15B is 
10 obtained. The numerals in Fig. 15B denote distance 

values or defocused values. The blank blocks are where 
it is determined that reliability of the result of 
correlation operation performed on these blocks is low 
due to low contrast of image signals, for instance. 
15 Next, grouping of blocks is performed in order to 

separate objects, in the object space, on the sensed 
images. After grouping, the M x n blocks are combined 
into areas each includes each object as shown in Fig. 
15C. Note that the hatched portions in Fig. 15C 
20 correspond to the blank blocks in Fig. 15B and are 

determined that reliability of the result of correlation 
operation in these areas is low due to low contrast of 
image signals, for instance. 

As for a method of grouping, there is a method of 
25 determining similarity of adjoining blocks by, e.g., 
comparing the values of the adjoining blocks shown in 
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Fig. 15B, and determining that the adjoining blocks are 
composed of the same object if the similarity is high, 
whereas, determining that they are composed of different 
objects if the similarity is low. Note, when the images 

5 are divided into relatively large blocks, as shown in 
Fig. 15B, the distance distribution information to be 
used for the grouping is simple values, such as distance 
values or defocused values; however, in a case where the 
block is very small, fine distance distribution 

10 information can be obtained, the information is often 
vectors normal to surfaces . 

For example, a distance value of a given block as 
shown in Fig. 15B is compared to respective distance 
values of its adjoining blocks, and if the difference 

15 between the distance values of the adjoining two blocks 
is within a predetermined threshold, then it is 
determined that "the objects in the blocks compose the 
same object' 7 . Whereas, if the distance is greater than 
the threshold, then it is determined that "the object in 

20 the blocks compose different objects. " By performing the 
aforesaid determination on every block, blocks are 
grouped into common objects. The grouped blocks which 
compose each object are dealt with as a group. 

Thereafter, characteristics of each group in the 

25 image are evaluated, and the group which includes the 
main object is determined out of all the groups. 
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In a case of the groups as shown in Fig. 15C, 
characteristics, such as average distances to the 
objects, widths, heights, and positions of the groups in 
the frame, are obtained for all the groups GRl to GR7, 

5 and evaluated as a whole, thereby determining the group 
which is considered to include the main object. For 
example, likelihood (possibility) of the group having 
the main object is obtained using a predetermined 
function, such as the following equation 1, then the 

10 obtained values are evaluated. 

(possibility) = Wl X (width) x (height) 

+ W2/ (distance from the center of frame) 

+ W3/ (average distance) ... (1) 

15 

In the equation 1, Wl, W2, and W3 are constants for 
weighting items, "distance from the center of frame" is 
the distance between the center of the frame and the 
center of mass of the group, and "average distance" is 
20 an average of distances to the object from the camera in 
all the blocks of each group. The probability is 
calculated for every group, and the group having the 
largest probability is determined as including the main 
object . 

25 Thereafter, a focal length is determined on the 

basis of the distance information of the group, 
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determined as including the main object, so as to focus 
on an object in the group, then the lens is actually 
moved to focus on the object. 

In the conventional focusing function as described 
5 above, an area including the main object is 

automatically determined on the basis of the aforesaid 
information, for instance, and focus control is 
performed on the basis of the determined result. 

However, there are a variety of scenes to be sensed 
10 and a variety of objects to be the main object; 

therefore, the main object which the user actually 
intends to focus on is not always correctly determined 
as the main object in the aforesaid method. 

Furthermore, an increase in the distance measuring 
15 points and areas caused by an increase in the number 

pixels of the CCDs complicates the determination of main 
object, which increases difficulty to focus on the main 
object completely automatically. However, since full- 
manual-selection of selecting the main object also 
20 complicates operation of a camera, it is desirable to 
realize unification of automatic control and manual 
control to a high degree. 

SUMMARY OF THE INVENTION 

25 
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The present invention has been made in 
consideration of the above situation, and has as its 
object to provide an optical device and method for 
selecting a distance measurement point capable of 
5 correctly selecting an object which an operator intends 
to focus on, and focusing on the selected object. 

According to the present invention, the foregoing 
object is attained by providing an optical device 
comprising: area discrimination means for discriminating 
10 a plurality of areas in a sensed image on the basis of a 
predetermined condition; main object area determination 
means for determining a main object area out of the 
plurality of areas discriminated by the area 
discrimination means; main object area changing means 
15 for changing the main object area to another area; and 

focus control means for focusing on the main object area. 

Further, the foregoing object is also attained by 
providing an distance measuring point selection method 
comprising: an area discrimination step of 
20 discriminating a plurality of areas in a sensed image on 
the basis of a predetermined condition; a main object 
area determination step of determining a main object 
area out of the plurality of areas discriminated in the 
area discrimination step; a main object area changing 
25 step of changing the main object area to another area; a 
change instruction detection means of detecting whether 
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or not there is any instruction to change the main 
object area; a control step of controlling to disable 
the main object area changing step when it is determined 
that there is no instruction to change the main object 

5 area in the change designation determination step; and a 
focus control step of focusing on the main object area. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 

10 drawings, in which like reference characters designate 

the same or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 The accompanying drawings, which are incorporated 

in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles of 
the invention. 

20 Fig. 1 is a block diagram illustrating a basic 

configuration of a camera according to a first 
embodiment of the present invention; 

Fig. 2 shows an optical arrangement of basic 
optical elements of the camera according to the first 

25 embodiment of the present invention; 
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Fig. 3 is a perspective view showing an arrangement 
of the optical elements of the camera according to the 
first embodiment of the present invention; 

Fig. 4 is a top view showing the arrangement of the 
5 optical elements of the camera according to the first 
embodiment of the present invention; 

Fig. 5 is a diagram illustrating an internal 
configuration of the camera; 

Fig. 6 is a flowchart showing a basic operation 
10 according to the first embodiment of the present 
invention; 

Fig. 7 is a flowchart of distance distribution 
generation processing according to the first embodiment 
of the present invention; 
15 Fig. 8 is a flowchart of main object area detection 

processing according to the first embodiment of the 
present invention; 

Fig. 9 is a flowchart of focal length determination 
processing according to the first embodiment of the 
20 present invention; 

Fig. 10 is a flowchart of main object area 
selection processing according to the first embodiment 
of the present invention; 

Fig. 11 is an explanatory view of a method for 
25 dividing an image into a plurality of areas; 
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Fig. 12A shows an example of an image sensed by the 
camera ; 

Fig. 12B shows a result of labeling of the image 
shown in Fig. 12A; 
5 Fig. 13 is a block diagram illustrating a basic 

configuration of a camera according to a second 
embodiment of the present invention; 

Fig. 14 is a flowchart of main object area 
selection processing according to the second embodiment 
10 of the present invention; and 

Figs. 15A to 15C are explanatory views for 
explaining the conventional distance measuring operation. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

15 

Preferred embodiment of the present invention will 
be described ,in detail in accordance with the 
' accompanying drawings. 

<First Embodiment> 
20 Taking a function of selecting a distance 

measurement point of an automatic focusing camera as an 
example, a system capable of arbitrary changing a main 
object area from an area, obtained as a result of 
automatic main object area selection, to another area 
25 using a single axis rotary operation member (dial) is 
explained. 
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Fig. 1 is a block diagram showing basic elements of 
a camera according to the first embodiment of the 
present invention. In Fig. 1, reference numeral 51 
denotes a distance distribution generation unit for 
measuring the distance to an arbitrary point in the 
object space; 52, a main object area determination unit 
for determining an area which most probably includes the 
main object (referred to as "main object area" 
hereinafter) in the sensed image; 53, a main object area 
changing unit for changing the main object area, 
determined automatically, to another area in response to 
a manual input; 54, a focal length determination unit 
for determining a control value to control the focus 
point of an optical system 55 on the basis of 
information on the determined main object area; 55, the 
optical system for sensing an image; and 56, a lens 
driver for driving the lens to focus. A dot line 57 is 
for indicating units which are realized by a CPU, RAM 
and ROM of a computer. Since the distance distribution 
generation unit 51 is realized with the computer and an 
optical system for distance measurement, and the main 
object area changing unit 53 is realized with the 
computer and an operation member, these units are shown 
on the dot line 57 . 
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A configuration of an optical system used for 
generating distance distribution information is 
explained below. 

Fig. 2 shows an optical arrangement of optical 
5 elements, of the camera, for measuring the distance to a 
point in the object space. In Fig. 2, reference numeral 
1 denotes an image sensing lens; 8, a field lens; 9, 
secondary focusing lenses; and 10, an area sensor. 
Fluxes, introduced by the image sensing lens 1 through 
10 different positions, incident on two image forming areas 
10a and 10b of the area sensor 10 in the magnification 
determined by the powers of the field lens 8 and the 
secondary focusing lenses 9. The area sensor 10 is 
arranged on a conjugate plane of a film to be exposed 
15 with respect to the image sensing lens 1, and all or a 
part of an image to be sensed is formed on each of the 
image forming areas 10a and 10b. 

Fig. 3 is a perspective view showing an arrangement 
of the optical system for measuring the distance, shown 
20 in Fig. 2, when it is applied to the camera. Referring 
to Fig. 3, reference numeral 6 denotes a quick return 
mirror; 18, a pentaprism; 19, a light-splitting prism ; 
and 20, a full-reflection mirror. Other reference 
numerals in Fig. 3 are same as those explained with 
25 reference to Fig. 2. 
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Fig. 4 is a top view when the arrangement shown in 
Fig. 3 is overlooked from above. 

Using an optical system as described above, two 
images having predetermined parallax are obtained. 

Note, a camera having the aforesaid configuration 
is disclosed in detail in the Japanese Patent 
Application Laid-Open No. 7-134238. 

Fig. 5 is a circuit diagram illustrating a 
configuration of the camera having the aforesaid optical 
system. First, each unit is explained. 

In Fig. 5, PRS denotes a camera controller, which 
may be a one-chip microcomputer having a CPU, ROM, RAM, 
and analog-digital converter. The camera controller PRS 
performs a series of operations of the camera, such as 
automatic exposure control, automatic focus control, and 
advancing and rewinding of a film, on the basis of 
sequence program stored in the ROM. Thus, the camera 
controller PRS communicates with inside circuits of the 
camera and a lens control unit using communication 
signals SO and SI, a synchronizing clock SCLK, and 
communication selection signals CLCM, CDDR and CICC, to 
control operation of each circuit and lens. 

Regarding communication signals, SO is a data 
signal outputted from the camera controller PRS, SI is a 
data signal inputted to the camera controller PRS, and 
SCLK is a synchronizing clock for signals SO and SI. 



Further, in Fig. 5, reference LCM denotes a lens 
communication buffer circuit, and it supplies electric 
power to a power input terminal VL for the lens when the 
camera is under operation, further, when the selection 
5 signal CLCM from the camera controller PRS is in high 
potential level (referred as T, and low potential 
level is referred as "L" , hereinafter), it acts as a 
communication buffer between the camera controller PRS 
and the lens . 

10 When the camera controller PRS controls the 

selection signal CLCM to be "H" and outputs 
predetermined data, such as the data signal SO, in 
synchronization with the synchronizing clock SCLK, the 
lens communication buffer circuit LCM outputs buffer 

15 signals LCK and DCL corresponding to the synchronizing 
clock SCLK and the data signal LO, respectively, to the 
lens via a communication node between the camera 
controller PRS and the lens. At the same time, a buffer 
signal of the signal DLC is outputted from a lens unit 

20 LNS as the data signal SI, and the camera controller PRS 
receives data of the lens as the data signal SI in 
synchronization with the synchronizing clock SCLK. 

Reference DDR denotes a circuit for detecting 
operation of various switches SWS and for display. It is 
25 selected when the signal CDDR is "H" , and controlled by 
the camera controller PRS by using the data signals SO 
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and SI, and the synchronizing clock SCLK. More 
specifically, the circuit DDR changes the displayed 
contents on a display member DSP of the camera on the 
basis of data sent from the camera controller PRS, and 
5 notifies the camera controller PRS of the ON /OFF state 
of each of the operation switches SWS of the camera* The 
state of the rotary operation member of the main object 
area changing unit 53 is also detected by the circuit 
DDR. 

10 Reference OLC denotes an outside liquid crystal 

display provided in the upper portion of the camera, and 
reference ILC denotes a liquid crystal display inside of 
a finder. 

Switches SW1 and SW2 are coupled with a shutter 
15 release button (not shown) , and with a half press of the 
shutter release button, the switch SW1 is turned on, and 
with a full press of the shutter release button, the 
switch SW2 is turned on. The camera controller PRS 
performs photometry and automatic focus adjustment in 
20 response to the "on" operation of the switch SW1, and in 
response to the "on" operation of the switch SW2, it 
controls exposure, thereafter, advances the film one 
frame. 

Note, the switch SW2 is connected to an 
25 interruption input terminal of the camera controller PRS, 
and even when programs triggered by the "on" operation 
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of the switch SWl is under execution, the "on" operation 
of the switch SW2 interrupts the execution, and the 
camera controller PRS swiftly moves to a predetermined 
interrupt program. 
5 Reference MTRl denotes a motor for advancing the 

film, and reference MTR2 denotes a motor for moving a 
mirror in the up and down direction and charging of a 
shutter spring, and the film and the mirror are 
controlled to move in the forward and reverse directions 
10 by the motors MDRl and MDR2 , respectively. Signals MlF, 
MIR, M2F and M2R, inputted from the camera controller 
PRS to driving circuits MDRl and MDR2 , are forward and 
reverse rotation control signals. 

References MGl and MG2 denote front and rear 
15 curtain operation magnets, which are supplied with 

electric power via amplifying transistors TR1 and TR2 in 
response to control signals SMG1 and SMG2, and the 
shutter is controlled by the camera controller PRS. Note, 
the motor driving circuits MDRl and MDR2 and shutter 
20 control are not directly related to the present 

invention, therefore, detailed explanation of them are 
omitted. 

A buffer signal DCL which is inputted to the lens 
controller LPRS in synchronization with the buffer 
25 signal LCK is instruction data from the camera 

controller PRS to the lens unit LNS, and operation of 
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the lens unit LNS corresponding to each instruction is 
predetermined. The lens controller LPRS analyzes the 
instruction in a predetermined procedure, and outputs 
operation states of focusing control, iris diaphragm 
5 control, the output signal DLC, each element of the lens 
unit LNS (e.g., operation states of focusing control 
optical system and operation states of iris diaphragm) , 
and various parameters (open f -number, focus distance, 
coefficient of amount of movement of focusing control 
10 optical system corresponding to defocus amount, various 
focus correction amounts, etc.) 

A zoom lens is explained in the first embodiment as 
an example, and when an instruction for focus adjustment 
is transmitted from the camera controller PRS, a motor 
15 LMTR for focus adjustment is operated on the basis of 

the signals LMF and LMR showing an amount and direction 
of displacement which are transmitted simultaneously. 
Accordingly, focus adjustment is performed by either 
rotating the optical system in the forward or reverse 
20 direction along the optical axis. The amount of 

displacement of the optical system is obtained in the 
following manner. First, a pattern of a pulse board, 
which rotates, coupled with the optical system, is 
detected by a photocoupler , monitoring a pulse signal 
25 SENCF outputted from an encoder ENCF which outputs 
pulses whose number corresponds to the displacement 
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amount. The number of the pulses SENCF is counted by a 
counter (not shown) provided inside of the lens 
controller LPRS. When the optical system finishes moving 
by a calculated amount, then the lens controller LPRS 
5 controls the signals IMF and LMR to "L" to operate the 
motor LMTR. 

Therefore, after an instruction for focus 
adjustment is transmitted from the camera controller PRS, 
the camera controller PRS does not care about operation 
10 of the lens until the lens finishes displacement. 

Further, the lens controller LPRS transmits the value of 
the counter to the camera controller PRS when the camera 
controller PRS requests to do so. 

When an instruction for controlling the iris 
15 diaphragm is transmitted from the camera controller PRS, 
a stepping motor DMTR, which is known for driving an 
iris diaphragm, is operated based on an iris diaphragm 
stage number transmitted at the same time. Note, since 
the stepping motor DMTR can control the opening of the 
20 iris diaphragm, an encoder for monitoring the operation 
is not necessary* 

Reference ENCZ denotes an encoder attached to a 
zoom optical system, and the lens controller LPRS 
detects the zoom position by receiving a signal SENCZ 
25 from the encoder ENCZ. The lens controller LPRS stores 
lens parameters corresponding to respective zoom 
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positions, and outputs a parameter corresponding to a 
current zoom position to the camera controller PRS when 
the camera controller PRS requests to do so. 

Reference ICC denotes an area sensor unit including 
5 area sensors, such as CCDs, and an operation circuit for 
operating the area sensors, which is used for focus 
state detection and photometry. The area sensor unit ICC 
is selected when the selection signal CICC is "H" , and 
controlled by the camera controller PRS using the data 
10 signals SO and SI, and the synchronizing clock SCLK. 

(j)V and 4>H are read signals for the area sensors, and 
<|>R is a reset signal. These sensor signals are generated 
by a driving circuit provided inside of the area sensor 
unit ICC on the basis of signals from the microcomputer 
15 PRS. The signals outputted from the area sensors are 
amplified, then inputted into an analog signal input 
terminal of the microcomputer PRS as output signals 
IMAGE. Thereafter, the microcomputer PRS converts the 
analog output signals IMAGE into digital signals, and 
20 the values of the digital signals are sequentially 

stored in the RAM at predetermined addresses. With these 
digitized signals, to generate distance distribution 
information in the object space, focus control, or 
photometry is performed. 
25 Reference DL denotes a rotary operation member, 

which is used for indicating the direction to change the 
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main object area, which will be explained later. Further, 
reference DLS denotes a sensor for detecting the rotated 
direction of the rotary operation member DL, which 
outputs a signal RTDR indicating the detected direction 
5 to the camera controller PRS. 

Note that the camera body and the lens are 
described detachable (i.e., lenses are exchangeable) in 
Fig. 5; however, the present invention is not limited to 
the camera of this type. For example, it is possible to 
10 apply the present invention to a camera whose camera 
body and lens are integrally composed. 

Below, a detailed operation and overall flow of the 
operation of the camera having the aforesaid 
configuration are explained with reference to Figs. 6 to 
15 12. 

First, referring to Fig. 6, an image sensing 
operation starts in step S100 when an operator presses a 
shutter release button (not shown), for instance. 

Next in step S101, a sub-routine for generating 
20 distance distribution information (distance distribution 
generation processing) in the object space is called by 
the distance distribution generation unit 51. 

Fig. 7 is a flowchart showing the distance 
distribution generation processing. 
25 In step S2 01 in Fig. 7, images are read from the 

area sensors. The image are read in the following manner. 
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First, the area sensors are reset. More specifically, by 
controlling the control signals (j)V, <j)H and <j)R to be "H" 
simultaneously for a predetermined period, residual 
charges are drained and the area sensor is reset, 
5 Next, the camera controller PRS transmits an 

instruction to start charging, and accumulation of 
charges starts in response to the instruction. After a 
predetermined period elapses, the accumulation of 
charges ends . 

10 Thereafter, the control signals <|>V and <J)H are 

controlled to drive the area sensors to sequentially 
output image signals IMAGE, which are A/D converted and 
stored in RAM in the camera controller PRS. Accordingly, 
image reading operation in step S201 is completed. 

15 The output image signals from the two area sensors 

are stored as IMG1 and IMG2 in a predetermined area of 
the RAM. 

Next, each of the images IMG1 and IMG2 obtained 
from the two area sensors is divided into M x n blocks 
20 and defocus distribution (defocus map) is generated in 
step S202 and its subsequent steps. 

First in step S202, variables x and y, which are 
for indicating a block, are initialized. Next in step 
S203, luminance signals necessary for performing 
25 distance measuring operation for a block B(x, y) , i.e., 
luminance signals of the block obtained from one of the 
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area sensors, are extracted from the image data IMGl 
stored in the RAM, and copied in the RAM at 
predetermined addresses A. 

In step S204, luminance signals necessary for 
5 performing distance measuring operation for the block 
B(x, y) are extracted from the image data IMG2 , and 
copied in the RAM at predetermined addresses B. 

In step S205, a known correlation operation COR(x, 
y) is performed on the luminance signals (luminance 
10 distribution signals) recorded at the addresses A and B, 
and a phase difference between the two luminance 
distributions is calculated. 

Thereafter, in step S206, a distance value or a 
defocused amount is obtained using any known function 
15 F() on the basis of the phase difference between 

luminance distributions calculated in step S205, and 
stored in the RAM at an address D(x, y) which is 
reserved for recording distance distribution information. 
In step S2 07, the variable x is increased by 1 to 
20 move a block to be processed to the next block. 

In step S208, x and the division number M in the x 
direction are compared, and if it is determined in step 
S208 that x is less than M, then the process returns to 
step S203, and a distance value or a defocused amount of 
25 the next block in the x direction is calculated and 

stored. If it is determined in step S208 that x is equal 



-21- 



to or greater than M, then the process moves to step 
S2 09, where x is initialized to 0 and y is increased by 
1. 

In step S210, y and the division number n in the y 
5 direction are compared, and if it is determined that y 
is less than n, then the process returns to step S203 
and the operation for the next row starts. Whereas, if 
it is determined that y is equal to or greater than n, 
then the process proceeds to step S211, where operation 
10 for obtaining a distance value or a defocused amount of 
every block has been completed. Accordingly, the 
distance distribution generation sub-routine of step 
S101 in Fig. 6 is completed. 

Next, in step S102, a sub-routine for detecting a 
15 main object area (main object area detection processing) 
is called by the main object area determination unit 52. 
The contents of the main object area detection sub- 
routine are explained with reference to Fig. 8. 

In step S3 01 in Fig. 8, operation for numbering 
20 respective objects (groups), configuring the object 
space, is performed. 

In a case of numbering (grouping) the blocks while 
performing raster scanning in the direction of an arrow 
from the left-uppermost block in Fig. 11, for instance, 
25 a determination whether or not a block of interest B(x, 
y) and its upper block B(x, y-1) belong to the same 
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group and a determination whether or not the block of 
i nterest B(x, y) and its left block B(x-1, y) belong to 
the same group are performed. Eventually, determination 
whether or not a given block and its adjoining blocks 
5 belong to the same block is performed on every block. In 
this case, blocks in the uppermost row (y=0) and the 
leftmost column (x=0) does not have upper blocks and 
left blocks, respectively; therefore, determination 
between the blocks in the uppermost row and their upper 
10 blocks, and between the left most column and their left 
blocks are not performed. 

Further, the results of determination are stored in 
the RAM at reserved addresses G(0, 0) to G(M-1, n-1) . 
First, the block B(x, y) = B(0, 0) is registered with a 
15 group number g = 1. Whenever a new group which composes 
another object is detected, the group number is 
increased by 1 and the increased number becomes the 
group number of the new group. With this operation, 
respective blocks of the sensed image as shown in Fig. 
20 12A are labeled group numbers for respective groups as 
shown in Fig. 12B. 

The numbering processing as described above is a 
known technique called "labeling method", and a 
flowchart of grouping of the blocks is omitted. Further 
25 determination method of determining whether or not two 
blocks belong to an identical group is disclosed in the 
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Japanese Patent Laid-Open Application No. 10-161013; 
accordingly, detailed explanation of the method is 
omitted. 

The number of groups detected in step S3 01 is set 

5 to a variable Gnum in step S3 02. 

In step S3 03 and its subsequent steps, 
characteristics of each group forming the sensed image 
are evaluated, and a group which most probably includes 
a main object (main object area) is determined out of 

10 all the groups (object areas) on the basis of the 
evaluated characteristics. First in step S303, a 
variable Gcur which denotes a group to be processed is 
set to 1. 

In step S304, a likelihood (probability), S(Gcur), 
15 of a block or blocks, forming a group Gcur, of including 
a main object is calculated. The probability S(Gcur) is 
determined on the basis of an average distance to an 
object included in the group, width and height of the 
group, and the location of the group in the image. A 
20 group which is considered to include the main object is 
determined on the basis of the calculated probabilities 
of all the groups. As for a function of calculating the 
possibility S(Gcur), the equation 1, described above, 
may be used. 
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In step S305, the value of Gcur is increased by 1, 
and the group subjected to the operation is proceeded to 
the next group. 

In step S3 06, Gcur and Gnum are compared to check 
5 whether or not the operation has been performed on all 
the groups. If Gcur is equal to or less than Gnum, then 
all the groups have not been processed; therefore, the 
process returns to step S304. Whereas, if Gcur is 
greater then Gnum, then the process proceeds to step 
10 S307. 

In step S307, using a function MAX, a group number 
having the maximum probability among the probabilities 
S(l) to S(Gnum) is found, and the group number having 
the greatest probability substitutes a variable Gmain. 
15 The blocks labeled the same group number as Gmain are 
determined as forming the main object area. 

In step S3 08, the main object area detection 
processing is completed; thus step S102 in Fig. 6 is 
finished. 

20 Thereafter, the process proceeds to step S103 in 

Fig. 6, where a process of determining a focal length 
(focal length determination processing) is performed by 
the focal length determination unit 54. Here, a sub- 
routine for determining a focal length on the basis of 

25 information on the main object area is executed. The 
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focal length determination processing is explained with 

reference to Fig. 9. 

In step S401 in Fig. 9, an area, in the object 

space, subjected to the focal length determination 
5 processing is set to the main object area on the basis 

of the group number detected in step S102 . 

In the subsequent step S402, distance information 

for focus adjustment is calculated on the basis of 

information on the main object area set in step S102 . 
10 Here, an algorithm which gives priority to the minimum 

distance in the object area is used, and the minimum 

distance to the object in the area is calculated. 

Thereafter, in step S403, the minimum distance is 

set as the distance to an object to be focused on; 
15 thereby the focal length determination processing is 

completed, and the process returns to the flowchart in 

Fig. 6. 

After the operation of steps S101 to S103, 
performed in the camera controller PRS, an instruction 

20 to control focus is transmitted to the lens from the 

camera controller PRS so as to focus on a point at the 
distance determined in step S103, and the lens 
controller LPRS controls the motor LMTR to focus on the 
object which is currently considered as the main object 

25 in step S104. 
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Next in step S105, whether or not the current focus 
state is proper, namely, whether the main object area 
which is currently selected includes the main object 
which the operator intends to focus on, is determined. 
5 In the first embodiment, whether or not the operator 
wishes to change the main object area is checked by 
detecting a state of the rotary operation member of the 
main object area changing unit 53 or a state of the 
switch SW2 of the shutter release button which trigger 

10 image sensing operation. More specifically, if the 

rotary operation member of the main object area changing 
unit 53 is operated before the switch SW2 of the shutter 
release button is turned on, then it is determined that 
the operator wishes to change the main object area, 

15 whereas, if the switch SW2 is turned on before detecting 
any operation of the rotary operation member, then it is 
determined that the operator is satisfied with the main 
object which is currently set. 

First, in a case of leaving the main object area 

20 unchanged, control signals SMG1 and SMG2 to the 

respective front and rear curtain operation magnets MG1 
and MG2 are generated at proper intervals by the camera 
controller PRS in step S107, the film is exposed, and 
the image sensing operation is completed. 

25 Whereas, if a change in main object area is 

requested in step S105, then the process proceeds to 
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step S106, where the process of selecting a main- object 
area is performed. 

The main object area selection process is explained 
with reference to Fig. 10. 
5 When a change in main object area is requested in 

step S105 as described above, namely, when the rotary 
operation member is operated, the direction of the 
rotation is detected in step S501. In the first 
embodiment, a system of inputting a moving direction in 

10 the object space from the currently selected main object 
area to an object area which the operator desires using 
the single axis rotary operation member DL (dial) . When 
rotation to the left is detected, the process proceeds 
to step S502, whereas when rotation to the right is 

15 detected, the process proceeds to step S503. 

In step S502 or S503, on the basis of the 
rotational direction detected in step S501, an object 
area on the left or right of the area which is currently 
selected as the main object area is set as a new main 

20 object area; accordingly, the main object area selection 
process is completed. 

After the selection of main object area by manual 
operation is performed in step SI 06 as described above, 
the process returns to step S103, where a focal length 

25 is determined on the basis of information on the current 
main object area. Further, the lens is moved in step 
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S104, and whether or not the current main' object area is 
to be changed is determined in step S105, and depending 
upon the determined result, either exposure operation in 
step S106 or the main object area selection processing 
5 in step S107 is performed. 

The operation of changing the main object area 
performed in step S501 and its subsecjuent steps is 
explained taking a scene in Fig. 12A as an example. If 
an object area of group number 3 in Fig. 12B is 
10 originally selected as the main object area, and if 

rotation of the dial to the right is detected in step 
S501, then an object area of group number 4 is selected 
as the new main object area, and lens is controlled to 
focus on an object in the new main object area of group 
15 number 4. If rotation of the dial to the right is 
detected again in step S501, then an object area of 
group number 6 is selected and set as the new main 
object area. 

In order to show which object area is currently 
20 selected as the main object area, an area selected as 
the main object area, namely, blocks having the 
identical group number, is surrounded by a line on a 
screen of a viewfinder. Alternatively, a mark may be 
displayed at a rough center of the main object area. 
25 When the object which the operator intends to is 

focused, by pushing the release shutter button until the 
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switch SW2 is turned on, image sensing operation is 
realized as desired. 

In the first embodiment as described above, only- 
one single axis rotary operation member is used as an 
5 input member. However, the present invention is not 
limited to this, and two single axis rotary operation 
members whose rotation axes are orthogonal to each other 
may be used. In this case, four directions of rotation 
(i.e., up, down, left and right) may be detected. A 

10 slide-type direction designation member may be used 
instead of the rotary operation member. Further, an 
operation member, such as a track ball, capable of 
freely rotating in any direction may be used. In this 
case, operability of the camera would be improved. 

15 Further, instead of designating the location of the 

main object area by an operation member, a priority 
order may be determined on the basis of the 
probabilities S(l) to S (Gnum) , which are results of 
evaluation functions, by sorting the probabilities, and 

20 the main object area may be changed from an object area 
having a higher probability to an object area having a 
lower probability. In a case where only one single axis 
rotary operation member is provided to the camera, a 
system of better operability may be realized by changing 

25 the main object area in accordance with a priority order. 
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<Second Embodiment> 

Next, a case where the operation member is a 
focusing system of an optical device, such as a camera, 
is explained as the second embodiment . 
5 In the second embodiment, so called a full-time 

manual type camera, whose automatic focusing system can 
be also operated manually is considered. A basic 
structure of the camera is the same as that explained in 
the first embodiment; therefore, configuration elements 

10 which are important for explaining the second embodiment 
are mainly described. 

Fig. 13 is a block diagram showing basic 
configuration elements of the camera according to the 
second embodiment of the present invention. In Fig. 13, 

15 reference numerals 51, 52, 54 and 55 refer to the same 
elements 51, 52, 54 and 55 shown in Fig. 1. A main 
object area changing unit 63 is within a dotted line 67 
which represents an area realized by a CPU, RAM and ROM 
of a computer, and a signal line from the lens driver 66 

20 to the main object area changing unit 63 is added (for 

notifying the moving direction of focal distance control 
member) , since the function of the operation member in 
the main object area changing unit 53 is moved to the 
lens driver 66. 

25 Note, by configuring the system so that the signal 

flows from the lens controller 66 to the main object 
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area changing unit 63 via the focal length determination 
unit 54, it is possible to simplify the configuration of 
the system. 

Fig. 14 is a flowchart of a main object area 
5 selection processing according to the second embodiment 
of the present invention. 

In the processing shown in Fig. 14, different from 
the processing shown in Fig. 10, the moving direction of 
the focusing system (rotation to the right and left when 
10 a normal rotation type focusing system is adopted) is 
determined in step S601, and depending upon the moving 
direction of either forward (in the approaching 
direction to the camera) or backward (in the receding 
direction from the camera) , the main object area is 
15 changed to an object area which includes an object at a 
shorter distance in step S603 or an object area which 
includes an object at a longer distance in step S602. 

More specifically, when the operator wishes to 
focus on an object which is at a shorter distance or at 
20 a longer distance than the distance where the currently 
focused object exists, the operator operates the 
focusing system in the desired direction, and the main 
object area is automatically changed to an object area 
which is in the direction the operator desires. 
25 The operation of changing the main object area is 

explained taking a scene in Fig. 12A as an example, 



-32- 



similarly to the first embodiment. If an object area of 
group number 3 in Fig. 12B is originally selected as the 
main object area, and if rotation of the focusing system 
in the direction to focus on an object at a longer 
5 distance is detected in step S601, then an object area 
which includes an object existing at a longer distance 
than the area of group number 3 is determined as the 
main object area on the basis of the distance value or 
the defocused amount detected in step S101 of Fig. 6. In 

10 this case, an object area labeled group number 4 is set 
as the new main object area, the focusing system is 
controlled so as to focus on the object in the new main 
object area. If the similar rotation of the focusing 
system is detected again in step S601, then an object 

15 area which includes an object existing at a longer 

distance than the area of group number 4, in this case 
an object area of group number 6, is selected and set as 
the new main object area. 

According to the first and second embodiments of 

20 the present invention as described above, a main object 
area which is automatically determined is checked by an 
operator, and if the determined area is not the area 
where the operator intends to focus on, it is possible 
for the operator to change the main object area to an 

25 arbitrary area by operating a predetermined operation 
member. 
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Accordingly, a camera capable of performing focus 
control while reflecting intention of the operator with 
easy operation is realized. 

The present invention is not limited to the above 
5 embodiments and various changes and modifications can be 
made within the spirit and scope of the present 
invention. Therefore to appraise the public of the scope 
of the present invention, the following claims are made. 
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What Is Claimed Is: 



1, An optical device comprising: 

area discrimination means for discriminating a 
plurality of areas in a sensed image on the basis of a 
predetermined condition; 

main object area determination means for 
determining a main object area out of the plurality of 
areas discriminated by said area discrimination means; 

main object area changing means for changing the 
main object area to another area; and 

focus control means for focusing on the main object 

area. 

2. The optical device according to claim 1, 
wherein said main object area changing means has 
direction designation means for designating a direction 
which is perpendicular to an optical axis of the optical 
device, and determines an area next to the main object 
area in the direction designated by said direction 
designation means as a new main object area. 

3. The optical device according to claim 2, 
wherein said direction designation means is a rotary 
operation member capable of rotating at least in two 
directions . 



4. The optical device according to claim 3, 
wherein said direction designation means is configured 
with a plurality of said rotary operation members * 

5 

5. The optical device according to claim 2 
wherein said direction designation means is a slide-type 
designation member capable of designating at least two 
directions . 

10 

6. The optical device according to claim 5, 
wherein said direction designation means is configured 
with a plurality of said slide-type designation members. 

15 7. The optical device according to claim 2, 

wherein said direction designation means is a track ball. 

8 . The optical device according to claim 2 , 
wherein said direction designation member is operated in 

20 manual . 

9. The optical device according to claim 1, 
wherein said area discrimination means discriminates the 
plurality of areas in the sensed image on the basis of 

25 distances to objects included in the sensed image, and 
said main object area changing means has direction 
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designation means for designating a direction along an 
optical axis of the optical device, and determines an 
area including an object a distance to which is next 
shorter or longer than a distance to an object included 
5 in the main object area as a new main object area 
depending upon the direction designated by said 
direction designation means. 

10. The optical device according to claim 9, 

10 wherein said direction designation means is a focusing 
member of an image sensing optical system. 

11. The optical device according to claim 10, 
wherein said direction designation member is operated in 

15 manual . 



12. The optical device according to claim 1, 
further comprising evaluation means for calculating an 
evaluation value by performing a predetermined operation 

20 for each of the plurality of areas discriminated by said 
area discrimination means, wherein said main object area 
determination means determines the main object area on 
the basis of the evaluation value calculated for each of 
the plurality of areas by said evaluation value 

25 calculation means . 
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13, The optical device according to claim 1, 
wherein said main object area determination means 
automatically determines the main object area. 



5 14. The optical device according to claim 1, 

further comprising priority order determination means 
for determining a priority order, and when a change in 
main object area is requested, main object area changing 
means changes the main object area in the descending 

10 order of the priority. 

15. The optical device according to claim 14, 
further comprising evaluation means for calculating an 
evaluation value by performing a predetermined operation 

15 for each of the plurality of areas discriminated by said 
area discrimination means, wherein said priority order 
determination means determines the priority order on the 
basis of the evaluation value calculated for each of the 
plurality of areas by said evaluation value calculation 

20 means . 



16. An distance measuring point selection method 
comprising: 

an area discrimination step of discriminating a 
25 plurality of areas in a sensed image on the basis of a 
predetermined condition; 
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a main object area determination step of 
determining a main object area out of the plurality of 
areas discriminated in said area discrimination step; 

a main object area changing step of changing the 
5 main object area to another area; 

a change instruction detection means of detecting 
whether or not there is any instruction to change the 
main object area; 

a control step of controlling to disable said main 
10 object area changing step when it is determined that 

there is no instruction to change the main object area 
in said change designation determination step; and 

a focus control step of focusing on the main object 

area. 

15 

17. The distance measuring point selection method 
according to claim 16, wherein, in said main object area 
changing step, an area next to the main object area in 
the direction designated from outside is selected as a 

20 new main object area. 

18. The distance measuring point selection method 
according to claim 17, wherein the direction designated 
from outside is selected from at least two directions. 

25 



-39- 



19. The distance measuring point selection method 
according to claim 18, wherein the direction designated 
from outside is perpendicular to an optical axis. 



5 20. The distance measuring point selection method 

according to claim 16, wherein, in said area 
discrimination step, the plurality of areas in the 
sensed image are discriminated on the basis of distances 
to objects included in the sensed image, and, in said 
10 main object area changing step, an area including an 
object a distance to which is next shorter or longer 
than a distance to an object included in the main object 
area is selected as a new main object area depending 
upon a direction designated from outside. 

15 

21. The distance measuring point selection method 
according to claim 20, wherein the direction designated 
from outside is an optical direction. 

20 22. The distance measuring point selection method 

according to claim 16, further comprising an evaluation 
step of calculating an evaluation value by performing a 
predetermined operation for each of the plurality of 
areas discriminated in said area discrimination step, 

25 wherein, in said main object area determination step, 
the main object area is determined on the basis of the 
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evaluation value calculated for each of the plurality of 
areas in said evaluation value calculation step. 

23 . The distance measuring point selection method 
5 according to claim 16, wherein, in said main object area 

determination step, the main object area is 
automatically determined. 

24. The distance measuring point selection method 
10 according to claim 16, wherein, the instruction to 

change the main object area detected in said change 
instruction detection means is designated manually. 



25. The distance measuring point selection method 
15 according to claim 16, further comprising a priority 

order determination step of determining a priority order, 
and when a change in main object area is requested, in 
said main object area changing step, the main object 
area is changed in the descending order of the priority. 

20 

26. The distance measuring point selection method 
according to claim 25, further comprising an evaluation 
step of calculating an evaluation value by performing a 
predetermined operation for each of the plurality of 

25 areas discriminated in said area discrimination step, 
wherein said priority order determination step, the 
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priority order is determined on the basis of the 
evaluation value calculated for each of the plurality of 
areas in said evaluation value calculation step* 



ABSTRACT 



A camera capable of automatically detecting a main 
object in a sensed image. A distance distribution 

5 generation unit discriminates a plurality of areas in 
the sensed image on the basis of a predetermined 
condition, and a main object area determination unit 
automatically determines the main object area out of the 
discriminated areas. If the determined main object area 

10 is different from the area where an operator intends to 
focus on and the operator wishes to change the main 
object area, a new main object area is selected in 
accordance with an instruction inputted from a main 
object area changing unit. Then, the camera focuses on 

15 the selected main object area. 
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any foreign application for patent or inventor's certificate, or PCT international application having a 
filing date before that of the application on which priority is claimed: 

(Yes/No) 

Country Application No. Filed fDav/Mo./YO Priority Claimed 

JAPAN 9-358512 25/12/1997 Yes 

I hereby appoint the practitioners associated with the firm and customer number provided below 
to prosecute this application and to transact all business in the Patent and Trademark Office connected 
therewith, and direct that all correspondence be addressed to the address associated with that Customer 
Number: 



FITZPATRICK, CELLA, HARPER & SCINTO 
Customer Number: 05514 



COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

(Page 2) 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements were 
made with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful 
false statements may jeopardize the validity of the application or any patent issued thereon. 

Full Name of Sole or First Inventor Hitoshi onqda 

Inventor's signature ^fc/i>Ccr^X ^ ^h^c6t^ _ 

Date JlarjeAul** /&>/C4f Citizen/Subject of Japan 

Residence c/o Canon Daini Aobadai Rvo, 36-1, Aobad ai 2-chome, 

Aoba-ku . Yokohama- shi , Kanacrawa-ken , Japan 

Post Office Address c/o CANON KABUSHIKI KAISHA, 

3 0-2, Shimomaruko 3-chome, Ohta-ku, To kyo, Japan 

Full Name of Second Joint Inventor, if any Keiii OHTAKA 

Second Inventor's signature s^AMA <^^M^ „ 

Date >Dlq2aUs^ jQ , /9f9^ fa tizen/Subject of Japan 

Residence 2007-27-120 , Kamikuratacho , Totsuka-ku, 

Yokohama- shi , Kanaaawa-ken , Japan 

Post Office Address c/o CANON KABUSHIKI KAISHA, 

3 0-2, Shimomaruko 3-chome, Ohta-ku, To kyo, Japan 

Full Name of Third Joint Inventor, if any Terutake KADOHARA 

Third Inventor's signature : ^LnjutfL^* $xU(P^OAJ^ 

Date ^MmjLtA fO. tfr9ft Citizen/Subject of Japan 

Residence 18-42-102, Tsunashimanishi 5-chome, Kohoku-ku, 

Yokohama-shi , Kanaaawa-ken , Japan 

Post Office Address c/o CANON KABUSHIKI KAISHA, 

30-2, Shimomaruko 3-chome, Ohta-ku, Tokvo, Japan 
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